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ABSTRACT 


During  the  past  ten  years  there  has  been  increasing  interest  in 

the  solution  of  allocation- type  problems*  Published  papers  on  the 
analytical  solution  of  such  problems  have  in  the  main  been  restricted 

to  particular  cases. 

This  paper,  while  not  offering  an  all-purpose  algorithm*  addresses 
the  problem  in  general  through  the  development  of  theorems  giving 
necessary  conditions  for  a  given  vector  or  function  to  be  a  solution* 
These  conditions  in  many  cases  enable  one  to  deduce  the  solution* 

The  paper  is  presented  in  two  parts*  The  first  addresses  the 
problem  of  maximizing  a  sum  of  n  functions  over  an  n-dimensional  sim¬ 
plex*  The  second  is  concerned  with  the  maximization  of  the  (Lebesgae) 
integral  of  a  functional  over  a  class  of  integrable  non-negative  func¬ 
tions  with  common  norm. 
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1, 


Introduction. 


During  the  past  ten  years  there  has  been  an  increasing  interest  in 

the  solution  of  allocation  type  problems  —  problems  that  are  concerned 
with  the  distribution  of  available  resources  in  a  manner  that  will  maxi¬ 
mize  some  sort  of  utility  or  payoff  function.  The  resources  may  be 
defined  in  terras  of  men,  materials,  money,  weight,  or  a  myriad  of  other 
conceptual  products  over  which  some  individual  has  control.  The  payoff 
may  be  in  terms  of  dollars  gained,  losses  to  an  opponent,  expected  value 
of  a  random  variable,  probability  of  the  occurrence  of  an  event,  or  a 
mixture  of  these  and  other  factors. 

A  fairly  large  literature  has  grown  up  around  these  allocation 
problems  as  they  apply  to  many  fields  of  endeavor  such  as  target  assign¬ 
ment,  theory  of  search,  theory  of  games,  etc.  However,  most  of  what  has 
been  published  has  been  in  the  form  of  particular  solutions  to  particu¬ 
lar  problems  (or  classes  of  problems). 

It  is  the  purpose  of  this  paper  to  set  forth  certain  theorems  which 
appear  to  be  at  the  heart  of  nearly  all  analytical  solutions  to  alloca¬ 
tion  type  problems.  The  theorems  in  Section  2  are  not  by  any  means 
original  but  have  been  used  by  mathematicians  for  years.  These  and 
Theorem  V  of  Section  4  were  first  introduced  to  the  author  by  Dr.  J.  M. 
Danskin  of  the  Institute  of  Naval  Studies  in  his  lectures  at  the  U.  S. 
Naval  Postgraduate  School  in  the  spring  of  1963.  Theorems  VI,  VII  and 
VIII,  while  apparently  never  before  published  (at  least  not  in  this 
form),  will  be  readily  seen  to  be  extensions  of  the  basic  concepts  of 
Theorems  II,  III  and  IV  respectively  to  the  case  of  the  Lebes gje  inte¬ 
gral  over  En. 
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It  is  hoped  that  a  study  of  the  theorems  and  examples  of  this 

paper  will  prepare  the  reader  who  is  concerned  with  the  analytical 
solution  of  allocation  type  problems  to  better  extend  the  reasoning 
of  the  authors  of  papers  attacking  certain  special  problems,  many  of 
which  are  referenced,  to  his  own  particular  problem  or  problem  area. 

The  order  of  development  in  this  paper  will  be  as  follows s 

First,  four  theorems  concerning  the  solution  of  finite  allocation 
problems  will  be  developed. 

Second,  two  examples  of  applications  of  the  first  four  theorems 
will  be  worked  out  and  a  discussion  of  appropriate  published  references 
will  be  presented. 

Third,  four  theorems  and  a  lemma  concerning  the  case  of  the  eon- 
tinuum  will  be  developed. 

Fourth,  two  examples  and  a  discussion  of  published  references  will 
be  presented. 

I  would  like  to  express  my  gratitude  for  the  encouragements,  guid¬ 
ance,  and  inspiration  which  Professor  Kenneth  Lucas  and  Dr.  John  Banskin 
provided  and  without  which  this  paper  would  not  have  been  possible. 
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2. 


The  Finite  Allocation  Problem. 


In  this  section  we  shall  develop  four  theorems  concerning  the  ana¬ 
lytical  solution  of  problems  in  which  one  desires  to  maximise  the  re¬ 
turn  from  the  allocation  of  a  fixed  resource  among  a  finite  number  of 
activities  each  of  which  has  associated  with  it  a  known  return  function,, 
Suppose  we  have  a  finite  number,  ny  of  activities  to  which  we  wish 
to  allocate  resources  available  in  a  fixed  quantity  X*  Suppose  further 
that  associated  with  each  activity  there  is  a  function  representing  our 
gain  upon  allocation  of  resource  to  that  activity.  That  is  f^  (x)  is 
the  gain  realized  from  the  allocation  of  an  amount  x  of  our  resource  to 
the  i'th  activity.  The  problem  we  are  concerned  with  is  to  maximize 
our  total  gain  by  the  proper  allocation  of  our  resources.  That  is  we 
wish  to  find  the  n-dimensional  vector  'x0  -  (x^0s,X2°),  • « oXir|°)  that  maxi¬ 


mizes  )  f,(x.)  subject  to  the  constraints  0  for  all  i 

Ll  1  1 

y  x  -  X  where  x.  represents  the  allocation  to  the  i°th  activity. 

fa1  ~  1 


Since  the  properties  derived  in  the  theorems  are  independent  of  X9 
or  the  x.'s  can  be  normalized,  we  shall  assume  henceforth  that  X  s  1. 

We  shall  also  assume  that  the  functions  f^  are  twice  continuously 
differentiable  (the  derivative  being  taken  from  the  right  at  0  and  from 
the  left  at  1)  in  what  follows.  In  all  but  Theorem  IV  this  restriction 
is  excessive.  For  the  reader  who  encounters  problems  not  meeting  the 
above  condition  the  allowable  reduction  of  the  restriction  in  Theorems 
I,  II  and  III  is  readily  apparent. 
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Theorem  I. 


,  o  o 

(*L  ,x2 

, . . c ,x  °)  maximizes 

>  >  n  7 

n 

r-  n 

iect  to 

;  x ,  r  1  and  x0  —  0 

number  X. 

such  that: 

M-l 

li 

xi°  >  0 

sA« 

X.°=  o 

1 

n 

Czl 


f:  (xt  ) 


(The  problem  and  constraints  set  forth  in  the  above  hynothesis 
shall  be  referred  to  as  "the  basic  problem”  throughout  the  remainder  of 
this  section.) 

Proof* 


xE  such  that: 


>  0. 

Then  construct 

xf  - 
xi  - 

x.o  -  f 

1  v 

where 

0  = 

xf  - 
J 

V  +  e 

for  saoe  j 

1  -• 

xk° 

for  k 

£  1 

Obviously  xf  is  admissible.  (Throughout  this  paper  the  tern 
admissible  will  refer  to  a  function  that  satisfies  the  constraints 
applied  in  the  statement  of  the  problem  to  functions  which  may  be  con- 
sidered  a  solution.) 


h 

Let  F(£)  :  Ylk(Xk  >  :fi(Ve)+fj(X i°+£  >  + 

fey 


k(KkO) 


-^O 


Since  x  maximizes  the  above  sum  F(£  )  achieves  its  maximum  when 
£  z  0  and  so  we  must  have  ?'(£) 


but:  F  (£) 


=  0 
£rO* 


=  f!(x.°)  -f^^o 
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implies  that  (1)  f^(x^°)  =  f^(x  °)  for  any  j^i 

We  now  observe  that  if  for  some  j^i,  x  .°^0,  we  can  by  the  same 
method  obtain  the  reverse  inequality ,  thus  giving  us i 
f,*  (x,°)^  f  *(x  o)  for  x  °>  0  &  j  ^  i 

1  1  j  j  i 

fi(x-°)  -  f  !(xs°)  for  X  °=>  0  &  x.0>CL 
i  j  J  i  j 

Taking  ^  to  be  the  common  value  of  f!(x  °)  for  those  x  °  which  are 

r  i  i 

positive  the  theorem  is  obtained. 

Theorem  II,  Given  the  basic  problem,,  if  all  the  f  are  strictly  concave 

(fV(x)<0)  and  x°  :  (x  °,x0°,..«x  °)  yields  the  maximum ,  then  there  is 

1  1 *  1 * * *  n 

a  number  ^  such  that  x^°>  0  if  and  only  if  f  (0)>y^  *  If  f^(0)>  ^ 
then  x^o  is  the  unique  solution  of  the  equation 
Proof : 

Apply  Theorem  I.  If  x^°>  we  see  that  f^(x^o) 
but  since  f^(x)<0,  f^  is  strictly  decreasing  in  x  so  that 
f'(0)-f!(x1o) 

On  the  other  hand  suppose  f^(0)=-^.  Theorem  I  states  that  if 
x^°  t  0  then  f^(0)2  ^  hence  x^^»  0  and  the  if  and  only  if  statement 
is  proven. 

To  finish  the  proof,  suppose  f^(0)>^.  Then  x^°=»  0  and  from 

Theorem  I  f^(x^5)  -  ^  •  That  there  is  a  unique  solution  to  this  equa¬ 
tion  follows  from  the  fact  that  f|(x)  is  strictly  decreasing  in  x. 

Theorem  III.  Given  the  basic  problem,  if  all  the  f  are  strictly  convex 


(f^(x)=*0)  and  "x°  -  (x^° ,X2° , • . .x  u)  yields  the  maximum,  then  there  is 
an  i  such  that  x^°  =  1  and  x^o  r  0  for  j£i.  (Geometr ically,  the 
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solution  lies  on  a  corner  of  the  simplex.) 

Proof. 

Consider  any  admissible  x  ~  (x  )  such  th&t  at 

1  Z  n 

least  two,  say  x.  and  of  its  components  are  positive.  We  know 
(since  x  is  admissible)  that  x.*=  1  and  x  «=  1. 

1  j 

Take  £  =»  0  such  that: 

xi  -  £  -  ° 

x .  -  £  >0 
x£  +  £  -=  1 

x  j  +  e  -=  i 

Define  x*  and  x2  as  follows: 


xl  X  X,  -  £ 

XJ  =  »j  +  £ 

x,l  =  x.  for 
k  k 

k£i»j 

xt2  =  xi  +  £ 

Xj2  x.  -£ 

xk2  r  xk  for 

i,  j 

Then 

and  x2  are  admissible  and  furthermore: 


-»  l  ,  2 

x  +  x  c 


x 


We  may  now  write: 

&<V=  £ 


~  n  " 

|iiil.txi2Ll 

Vf  (X  ‘J  +  <*  2, 

Z  /  2 

6--X  J 
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The  inequality  holds  because  each  of  the  f  is  strictly  convex  and 

n  *  rt 


lW  must  be  less  than  ^  f ) 
6=2  o^l 


"x  ^  and  x 2  differ.  Hence 
or  less  than  ^f^(x  2)  or  both  and  thus  lx  does  not  yield  the  ra 


c*L 

mum.  Thus  if  “x0  is  not  a  corner  of  the  simplex*  is  not  the  solu¬ 

tion. 

Note*  The  solution  for  the  above  case  is  not  necessarily  unique, 
is,  more  than  one  corner  of  the  simplex  could  yield  the  same  maxi 
value.  However,  we  can  see  that  ail  that  is  necessary  to  solve  the  prob¬ 
lem  for  the  convex  case  is  to  evaluate  each  f.  at  x.  ~  1  (or  X  if  we 

x\ 

have  not  normalized)  and  select  that  activity  which  yields  the  highest 
return. 

Theorem  IV.  Given  the  basic  problem.  If  "x°  -  .  •  •*o0>)  is 

maximizing  solution,  then  0  for  all  x,°  which  are  positive 

i  jl  r 

with  at  most  one  exception. 

Proof.  Suppose  we  have  an  admissible  x°  with 


x{°*-0,  x.°=-0,  fV(x„°)>0  and  f'7(x.°)>0 
1  j  11  J  J 


Let 


cr  z  */>+  x  ° 


£  =  min  (x^,  x2°) 


Now  consider  the  problem; 


(1)  Maximize  f ^(x^) + f ^ (x^)  subject  to 


x  0  ,  x  •  ^  0  &  x.+  x,  z  C~ 

i—  J  l  j 


If  It  °  maximizes  the  original  problems,  we  see  that  the  pair 
(x^°,  x^°)  must  provide  the  solution  to  (1). 
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Since  both  fV  and  f *.*  are  continuous,  we  can  find  a  <f  =»  0  such  that 

<f  <  £  and  for  /??/=  &  we  have  f 'J(x  °+}7  )  =** 0  and  f'.'(x .%?{  )  =» 0. 

**  i  *  j  J 

(This  is  the  only  place  we  utilize  the  full  power  of  the  constraints 

placed  on  the  f . 1 s. ) 

x 

Let  F(^)  r  fi<xi°+^  >4*  f  j(Xj°  -  r\)  .  For  W-6  we  have 

F"(7^  )=*  0  so  that  F(7(  )  is  convex  and  achieves  its  maximum  on  the  in¬ 
terval  ["“(£»<£*]  at  -(f  or  at  +  £  but  since 

(xicV^)+(xj°  -7{  )  *  CT  this  shows  us  that  (x^0,*^0)  can  not  be  the 
solution  to  Problem  (1).  Thus  any  such  xv  can  not  yield  the  maximum 
to  our  original  problem. 
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* 

3.  Examples  of  the  Finite  Fioblera. 

The  theorems  of  the  last  section  or  variations  of  them  have  proved 
useful  in  a  large  number  of  mathematical  applications.  Included  in  these 
"al  location”  problems  are  weapons  assignment  s  solut  ions  to  games  3  and 
many  other  problems  concerned  with  the  optimum  distribution  of  effort  or 
resources. 

It  is  the  purpose  of  this  section  to  illustrate  through  simple  ex¬ 
amples  the  application  of  the  theorems  of  Section  2  to  the  solution  of 
problems.  References  will  be  given  to  several  papers  and  books  which 
treat  similar  problems  by  this  method  and  also  to  several  which  contain 
a  different  approach  to  the  solution  to  these  problems. 

Example  1.  (This  example  is  based  on  a  problem  posed  by  Dr.  John 
M.  Danskin  of  the  Institute  of  Naval  Studies  in  his  lectures  on  Search 
Theory  during  the  spring  of  1963.) 

Suppose  in  the  problem  described  prior  to  Theorem  1  we  let  the  n 
activities  be  interpreted  as  n  available  targets  while  x^  represents  the 
number  (of  a  fixed  number  X)  of  weapons  we  allocate  to  the  i*th  target. 
Suppose  the  probability  of  destroying  the  i'th  target  with  x  weapons  is 
—  b  “  x 

1  -e  x  where  0  is  a  parameter  representing  weapon  reliability 9 
accuracy,  target  defenses,  etc.  Suppose  further  that  the  destruction 
of  the  i*th  target  results  in  a  gain  to  us  of  0  units.  We  now  de¬ 
sire  to  allocate  our  weapons  in  such  a  manner  as  to  maximize  our 
expected  payoff  (gain)  with  respect  to  the  probabilities  of  destruc¬ 
tion.  Our  problem  then  is: 

n 

~bixi 

maximize  )a  (1-e  ) 
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Subject  to=  x.  —0  for  all  1  „ 

1  "" 


by  letting  y.  r  xi  we  can  normalize  this  problem  and  rewrite  itz 

1  T 


maximize 


l-l 


subject  to:  y.  ^  0  for  all  i 


1 


where  y^  represents  the  proportion  of  our  total  arsenal  X  that  we 


allocate  to  the  i’th  target.  In  this  example  we  shall  determine  the 
solution  for  both  variations  to  show  that  they  are  indeed  the  same* 

(We  shall  adopt  the  notational  scheme  of  numbering  equations  for  the 
first  problem  and  using  the  same  numbers  with  a  prime  for  the  analogous 
equations  for  the  second  problem.) 

We  now  haves 


O')  g7(yjL)  :  -a^Ve 


<  0  for  all  i  6c 
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We  shall  now  let  c,  z  h.  X  . 

i  i 


Since  fM(x)cO  for  all  1  &  x  and  gM(y)<  0  for  all  i  &  Ys  we  see 

i  x 

that  Theorem  II  applies  in  both  cases.  So  we  calculates 

(4)  q(0)  ;  aibi 

<4')  g'(0)  r  aicl 

and  the  application  of  Theorem  II  gives  us t 
( 

(5) 


x.°=»-  0 
i 

iff 

aibi> 

x.°:  0 

iff 

a  *  b 

l  i— 

H* 

0 

V 

o 

iff 

aicr 

o 

II 

0 

•H 

>> 

iff 

a.c  .< 

i  i=< 

(5’)  / 


We  see  from  (5)  6c  (5')  that  if  the  solutions  are  equivalent  we  must 

have  Ay  =  XAx* 

Now  applying  the  second  half  of  Theorem  II  we  obtains 


for  all  i  such  that  xe°=»  0: 

i 


f!(x  °)  =  aibi  e 


bVi 

ixi 


A, 


or  after  multiplying  by  and  taking  logarithms  of  hot'1'] 

sides : 


rt.\  „  o  1  , „ 

<6)  In 


XT 


Similarly  for  i  such  that  y  >0: 


(6’)  y, 


ci 


In  tilt 

Ay 


We  now  re-label  the  targets  so  that  a^b^  ^2^2  =  =an^r 


For 
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any  we  find  its  position  in  this  string  of  inequalities. 

tice  that  }  _  must  be  less  than  a  b  since  otherwise  we  would  have 
'  ^  x  n  n 

all  z  0.)  Having  chosen  ^  we  set 

/ 

<.°  r  0  for  a.b.  <  ) 

1  i  i  —  ^x 


(7) 


a.  b  * 


Xi°  :  A-  ^  “V1  ^  “ibi^ 

bi  Ax 


,!e  now  vary  to  obtain; 


(8)  ^ x . °  r  ^  bj 

Similarly  using  the  same  ordering  (a^fe^ >  X 

r  a..bj  X),  we  obtain  for  the  second  problem; 

y.°  =  0  for  aiCjL-Xy 


In  >lbl 

11  TT 

/x.  x 


a,c ,  >  a  .c . 

i  r  J  J 


(7’) 


o  1_ 
c 


aic 

x 


Yi  =  r  In  — r~i  ,  for  a  c  =*) 

i  i 


and  we  vary  ^  to  obtain; 


(8') 


fji  --  Yji  in  ^ 


i^q>\ 


Substituting  for  co  into  8 9  we  obtain 

x 


1  3*8,-  X 

b‘x  ln  i  ■’  1 

6  Ay 


or 


ft  ln 

i 


b 


i  i 


■y/X 


X  and  we  see 


that  )  r  X  i  and  the  two  solutions  are  equivalent* 

Ay  '  v  X 
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From  this  we  see  that  the  product  is  the  factor  that  deter- 

mines  whether  or  not  a  target  is  attacked*  So,  if  a  new  target  arises 

we  can  compute  the  new  product  ab  and  if  the  new  ab>  is  less  than  ^ ^  y 

the  new  target  will  not  be  attacked.  If  the  new  ab  is  greater  than  \ 

then  it  will  be  attacked  and  a  new  \  must  be  calculated. 

/vx 


Example  2. 

Consider  the  two-person  zero-sura  game  with  payoff  Ketnal 

h 

K(x, y)  r  /  aixie  where  a,  &  b.>  0  and  xe  &  y.  are  the  coordi- 

r—  i  r  i  7  r 

C=1 


nates  of  the  n-dimensional  vectors  x  and  y  constrained  by  x  ,y  =  0 

i  1 

for  all  i  and 


X> i  c  ;  ; 


We  might  consider  the 


a, fs  to  represent  target  values;  the  bu's  target  defensibility ;  x,  the 

x  x.  i 

allocation  of  weapons  to  target  i  by  player  1  who  desires  to  maximize 
K(x,  y)  ;  and  y^  the  allocation  of  defenses  to  target  i  by  player  11  who 
desires  to  minimize  K(*x,~y)  .  For  convenience  we  shall  assume  c  &  d  *  1. 
The  existence  of  a  solution  to  this  game,  that  is  a  pair  (x°,  y°)  such 

that  K(x°,  *y°)  K(>f,  *y°)  for  all  x  in  the  simplex  and 

K(x°,  "y0)^K(x°,  "y)  for  *11  *y  in  the  simplex  will  not  be  proved  here. 
Such  a  pair  can  be  shown  to  exist. 

Our  problem  then  is  to  find  the  pair  (x°,  ~yJ)  such  that; 


(2)  x.°  ^  0  ;  y^°  =  0  for  all  i 
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(3)  K(>f,  "y°)  =  K(x°,  “y°)  S  K(x°,  y  ),  for  all  *x  and  "y 
satisfying  (1)  and  (2). 

Looking  at  (3)  in  the  light  of  the  theorems  of  the  last  section  we 
see  we  have  a  pair  of  maximization  problems* 

(4)  Maximize  K(x,  “y°)  subject  to 


*L=  0  for  all  i. 


i- 


L  =  Z 


z  1  and 


(5)  Maximize  -K(x°,  “y  )  subject  to 
y^  =  0  for  all  i. 


Upon  differentiating  K(x\ ~y°)  = 


n 


C*1 


*.x.  e 

3L  i 


rt 


=biYi0 


y^  -  1  and 


by  x^  and  apply¬ 


ing  Theorem  I,  we  see  that  there  must  be  number  A  such  that; 


(6)  ^  e 


'Vi0 


-  A  xi0>  0 

=  A  if  x  ®  s  0 


Sq  ^ 

Similarly  from  -K(x  ,  y)  we  see  there  must  be  a  number  k  such  that; 


°  »  0 


,7N  .  o  -Vi0  1=  k  if  yt 

(7)  a£bixi  e  / 

k  if  y,«  ;  0 

From  an  examination  of  (6)  and  (7)  we  can  determine  the  followings 
(a)  k  >  0  ;  There  must  be  at  least  one  i  for  which  x  ^  0 

-  i 


(b)  y. 


This  with  (7)  gives  k  ^  0. 

>  x^°  ^  0  ;  If  yL°^  0,  then 

=  k  >  0  / 


•Vt 


o 


x  =»  0, 

i 


(c)  a^<A^^  XA  =  0  y^°  z  0  ;  The  first  implication  follows 


directly  from  (6).  The  second  is  a  consequence  of 
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(d)  ai  : j  y,  :  0  ;  If  ai  :  A  ’  then  yfG=>  0  ^  xi°  s  0  bY 

(6);  but,  by  (c)  x  °  -  0  :=>  y  o  r  0  „ 

1  i 

(e)  a£  -  A  Xi°  ==  aTbT  ’  Substitute  y^°  «  0  into  (7) 

(f)  ;=>  y^s*  0  xt°>  0  ;  This  follows  directly  from 

(6)  and  (b)„ 

Now  to  determine  a  solution  we  proceed  as  follows: 

We  see  from  (c),  (d),  (e)  and  (f)  that  we  need  only  consider  those 

i  for  which  a.=  )  . 

1  .  o 

From  (6):  a^ \  a^e  1  1 

Substituting  this  into  (7)  we  obtain: 

(8)  b.A  *i°  =  k=»*i°  ,  for  &r  ^  . 

From  (e)  we  obtain: 


(9)  x.°  £  :  _i<  ,  for  a.  -  ) 

1  Vi  hT  1  ‘A 


If  we  let  Z  r 


vi  = 


”i 

cia.:-}-  cj<2;  =  X 


then 


i<-  is'l-t-il't 

c9^y%  £33.;=  I  C33c->A 


+  Z  r  1. 


Now  if  we  define  B 


l 


C33c->?. 


1 


>1  s 


then  for  Z  =  0  (that  is  x^o  -  0  for  a^  =  A)  we  have: 

*  1  -■  I  Bo=>  k  =  r0 


C  -1 
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However 


>  if  we  set  x  °  -  Y_  when  a  _) 

1  Abi  1  A 


we  have : 


B,  =  l  =>  k  : 


A 


We  can  thus  see  that  we  have 


V) 

(10)  j  BqS  £\°  =  1  =  y  Bl 


A 


So  we  have: 

(11)  A_  ^  k  -  A 

B,  -  -  B 

1  o 

Using  (10)  we  see  that  for  any  value  of  k  satisfying 
find  a  number yO  with  0  =  //  =  l  such  that: 

(12)  4  B0  '^B„>  =  l- 


A 


Recalling  the  definition  of  Bq  and  B.  (12)  becomes: 


i.Ii 

t  3S;>?i 


+  u  Jl 

^  A  U  bt 

c93^=X 


1  . 


we  can 


So  by  setting  x.°  =  yO  Y.  fnr  a  -  1  •  v  °  -  k  for  a. 

1  T^T  1 ' A  1  '  X^  • 

and  x^°  =  0  for  a^«=  ^  ,  we  obtain  a  solution  for  player  1. 

For  player  II  we  have  y^° 0  only  if  ^  .  But  for  a^A 
we  have 

o  k 

*  Abi 

So  we  get  from  (7): 


A 


or 


libi  e  biyi  :  k  for  ai=>A 

ai 

X 


a,  -biYi0  r  1*  Miltiplying  by  A=  and  taking 


A 

ai 
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logarithms  of  both  sides  we  obtain 

-Vi”  =  ln  A  or 

ai 


1  In  ai 


A 


Thus  we  can  obtain  ^  as  the  solution  to  the  equation* 
V  1  ai 

<13>  Ih  =  )  b”  !n  f  :  1 

in  the  same  manner  as  in  Example  1* 

Thus  we  can  express  the  final  solution  to  the  game; 

=  k'A*>i 


for  3.=*^ 

for  a.  rA 

for  a^<-^ 

where:  (a) 


o  1  i 

n  .  ^  ± 


A  4*  W  ■>  m* 

1  Ab.i 


A  satisfies 


In  ~1 


A 


i 


(b)  k  is  not  unique  but  any  number  satisfying; 

X  I  ^  1  =  1  I  ^ 

^  3<2;>A 

(c)  ^4/  is  the  number  for  the  chosen  value  of  k  such  that: 

k 


i 


I 


c9^A 


C  e2^  —  /i 


Substituting  the  solution  (x  ,v  )  into  the  expression  for  K  we  see 
that  the  Mvaiu«  of  the  game"  is 
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c  =  x 


v 


o 


*  i° 


iAi 


£W-». 


The  preceding  examples  are  highly  simplified  and  are  meant  to  serve 
as  an  illustration  of  the  method  of  applying  theorems  I  through  IV,  not 
as  examples  of  applications.  For  a  much  more  sophisticated  and  realis¬ 
tic  application  of  the  theorems  the  reader  is  referred  to  the  papers  by 
J.  M.  Danskin  on  Convoy  Routing  |sj  and  Theory  of  Reconnaissance  [5 J. 

For  an  appraisal  of  the  earlier  work  done  in  this  field  with  much 
more  severe  restrictions  on  the  nature  of  the  problem  the  reader  is  re¬ 
ferred  to  the  papers  by  Charnes  and  Cooper  [2]  and  deGuenin  £7j. 

The  reader  has  probably  observed  that  the  solution  obtained  by 
application  of  Theorems  1  through  IV  will  not,  in  general,  provide  inte¬ 
gral  assignments.  Thus  we  may  be  faced  with  the  problem  of  interpreting 
the  meaning  of  assigning  0.7  bombs  to  a  target.  Further,  in  some  cases 
the  solution  to  an  allocation  problem  is  very  unstable  (this  is  the  case 
when  the  payoff  functions  f^(x)  are  S-shaped,  first  convex  and  then  con¬ 
cave  as  x  increases).  In  cases  of  this  type  our  method  may  not  give  us 
any  useful  information.  The  paper  by  Karush  [llj  addresses  this  problem 
and  contains  some  very  interesting  examples  pointing  up  the  danger  of 
attempting  to  deduce  an  integer  solution  from  the  analytical  solution 
(these  examples  are  readily  apparent  upon  reading  the  article  although 
not  specifically  referred  to  therein).  Bellman's  book  [l]  provides  a 
fine  computer  oriented  approach  to  the  solution  of  allocation  problems 
by  the  generation  of  sequences  of  functional  equations.  Other  approaches 
to  special  types  of  allocation  problems  can  be  found  in  the  papers  by 
den  Broeder,  Ellison  &  Emerling  [8]  ,  Lemus  6c  David  IjL3j  ,  Manne  jjL4j  and 
Piccariello  [10. 
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4.  The  Case  of  the  Continuum, 

In  this  section  we  shall  consider  the  analog  of  the  problem  of  Sec¬ 
tion  2  in  which  we  are  allocating  our  resource  over  a  continuum  of 
activities.  Examples  might  be  the  distribution  of  searching  effort 
(effort  spent  on  a  point  represented  by  the  velocity  at  which  the  point 
is  traversed)  over  an  area  or  the  positioning  of  barrier  forces  in  order 
to  protect  an  instal lation.  We  will  develop  four  theorems  analogous  to 
those  of  Section  2, 

The  following  lemma  and  four  theorems  are  based  on  Lebesgue  meas¬ 
ure  and  integrals.  In  what  follows  we  shall  let: 
m  be  Lebeigue  measure 
W  be  an  integrable  function 
g  be  a  measurable,  non-negative  function 
X  be  the  class  of  all  integrable8  non-negative  functions 
bounded  above  by  g  and  such  that  -  c  whenever  x£X. 

All  of  the  above  are  defined  on  E  • 


Lemma  I . 


y?£  X  maximizes  J  Wx  over  all  xf  X  if  and  only  if  there 
exists  a  number  X  such  that  for  almost  all  t: 


(1)  W(t) 


/ 

=  A 
<  --  A 
Z  A 


if  x°(t)  z  g(t) 
if  0  <  x°(t) «=  g(t) 
if  x°(t)  =  0 


Proof ; 


a. 


Sufficiency, 

Suppose  x°(t)  satisfies  (1), 


We  must  show  that: 
for  all  x£  X, 
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We  can  write® 


(2)  Jw(t)[x°(t)  -  x(t)j  =  Jjw(t)  -X  [x°(t)  -  x(t)j 

since  J^x°(t)  -  x(  t)j  :  /lc  -  Ac  :  0 

We  now  decompose  En  into  three  disjoint  measurable  sets: 

SL  :  [t:  W(t)  a] 

52  s  (t:  W(t)  =  X} 

53  =  £t:  W(t)  >  X] 

Then  (2)  becomes: 

[w(t)  -  A  ]  [  X°(c)  -  x(t)j  ~h  /  [w(t)  -  x]  [  X°(t)  "  X(t)j 


[w(t>  -  a]  [  x°(t)  -  x( c)j 


We  observe  chat; 


On  S j  :  W(t)  -  A  ^  0  and  x°(t)  r  0  Thus 

o  . 

x  (t)  -  x(t)^  0.  So,  the  integrand  and  consequently 

the  integral  is  non-negative , 

On  S2  :  W(t)  - /L  z  0  so  the  integral  is  zero. 

On  :  W(t)  •  A  )  0  and  x°(t)  r  g( t)  thus 

x°(t)  -  x(t)^  0  and  so,  as  on  the  integral  is  non¬ 
negative  . 

This  proves  sufficiency* 
b„  Necessity, 

Suppose  x°(t)  maximizes  the  integral  subject  to  the  con¬ 
straints  of  Xo 
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We  note  that  Lebei  gue  measurability  is  equivalent  to  approximate 


continuity  almost  everywhere.  (See  Munroe  Lib],  p.  292  or  Saks  /jLtJ, 
p.  132.) 


Let  t  and  t  be  two  distinct  points  of  approximate  continuity  of 
o  l 

x°,  W,  and  g  such  that  x°(t0)<  g(to)  and  x°(t^)^0  (If  no  two  such 
points  exist,  the  problem  is  degenerate.) 

The  following  property  of  a  function  in  a  neighborhood  of  a  point 
of  approximate  continuity  is  vital  to  the  remainder  of  the  proof. 

If  x  is  approximately  continuous  at  tQ,  then  for  any  £  >  0  and 
>  0  there  exists  £  >  0  such  that  for  any  interval  I  containing  tQ 
such  that  we  have: 

m<E  */)!)>  (1  ~Yf  )m  (i) 

o  ' 

ft  s  l  X(t)  “  x(t o)j<£j 


where 


x 


Now 


let  us  choose  ^  -  1/6S  an  arbitrary  CT >  0  ,  and  £  >  0  such 


that: 


X°(t  )  +  40  <  g(tQ)  and  X  (t,  )  *  3£  >  0. 


Define ; 

EqX  z  [t;  x°<c)  <  8(c0)  "  3^j 

EoW  2  it:  W(t)  >  W(tc)  -  <r} 

Ec8  .  £t:  8(0  >  8(t0)  -  sl 

Exx  s  ft;  x°(t)  >  2  £  } 

E1W  £  ft:  W(t)  <  WUj)  +  <rj 

Et8  =  ft:  g(t)  >  g(tj)  -  £] 


Then  we  can  find  <$0X,  50W.  <£08.  tSj*.  <^1w»  <^8  aLl  >  0 
such  that  for; 
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t  £  I  X  &  »n(i  X)  <  m(E  X/1  I  X)  >  5/6  m(I  X) 

O  O  GO®®  ° 

t  £  I  w  &  m(X  w)<  S  ®(E  WD  I  w)  >  5/6  m(I  W) 

o  o  O  O  0°  ° 

t  e  I  8  &  m(I  8)  <  r  8,  o(E  8f|I  8)  >  5/6  m(I  8) 

°  O  o  °o  oo  ° 

t.  £  I  X  &  «(I  x)<  <5  *  mCE^Ol/)  >  5/6  0(1  x) 

tj  e  iLw  &  ra(I1W)<  <£  tW,  >  5/6  m(I1W) 

tj£  1^  &  ro(Ii®)<  £*,  ®(E18ni1§)>  5/6  mdj8) 

We  not#  take  <5  such  that; 

0<  $  <min  <£*,  6",  g«,  £\  <$;«,  £8> 
o  o  o  1  i  1 

and  I  and  1,  such  that  tQ  £  Iq  and  Ij_  ,  Io0  ^  =  0  and 

(3)  0<  m(Io)  r  0(1^6 

Let; 

(4,  to:£.‘nE»"n'.,f'1. 

(5)  Ej  =  n  EtW0  Et8  n  Ij 

then; 

»«„)  =  ■<!„>  -  *U0-E0)  --  “'V  -  ra(to  ■  ’ 

=  »<!„)  -  4io-*ox)Ua0-*o,,)t/<1.  ■".*>> 

>m(I  )  -  o(I  -  E  X)  -  o(I  -  e”)  -m(I  E  8) 

^  v  0/  Oo  ®  Q  O  O 

>  m(Io)  -  £  o(I0)  -  \  o(I0)  *  6  ffl<V 

=  1/2  m(l  ). 

o 

Thus  we  have 

(6)  m(E0) >1/2  m(l0) 
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and  by  the  same  reasoning  we  have 

O)  n(E  )>  in  ffiCip 


Using  (3),  i1*}  „  (5}s  (6)  and  (7)  we  obtains 

1/2  m(E  1/2  m(I0)  s  1/2  m(I1)<m(E1)^  m(I  ) 

or  1/2  m(E0)<  ffl(El)<2a(E0) 
and  since  ®(E0)J>  0  we  can  write 


«<I0>  <  2  m(E0) 


1/2  < 


) 

m(E0) 


<  2 


Next  define 


o  m(E^) 


1 

x  (t) 


x  (t)  +  £ 


m(E0) 


x°(t) 


o 

x  (t) 


on  E 


on  E, 


elsewhere. 


We  observe 


on  E 


on  E 


r 


X1(t)  r  x°(t)  +  £  <  x°(t)  -f~  2  £ 

ffl  Eq 

<  g(tQ)  -£  <  g(t) 

xl(t)  =  x°(t)  -£  >£  >  0 
xX(t)  r  x°(t)  “£<  x°(t)  <  g(t) 


and 


/X‘  *J>+/e( 


m 


(El) 


£ 


x°  -h  £  m(E,  )  -  £  m(E,  )  :  C. 


so  xl  £  X  . 


Now  since  x°(  t)  maximizes  our  integral  we  can  write; 
JW(t)  x°(t)  ^  Jv(t)  xl(t) 


and  using  the  definition  of  x^(t)  this  becomes 
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(8) 


m(El) 


but  E  and  £,  were  chosen  such  that 
o  I 


W(t) 


W(t}>  W(t0)  -cr  on  Eo 
W(t)<  W(tj)+<7-  on 


so  we  have  upon  dividing  both  sides  of  (8)  by  £  ; 

f  mCE^ 

(WCtp+er)  taCEp^  /  U(t)^s(E~7  w(t»  (W(t0)  -  <T)m(E1) 


Upon  dividing  through  by  m(E,)  which  was  chosen  to  be  non  zero  we 

I 

obtain 


WCt^cr  W(to)  -  (J~  where  <j-ts  arbitrary. 

Thus  W(tx)  ^  W(t  ). 

O  o 

Since  all  we  required  was  that  x  (t>)>0  and  x  (tc)<g(t  )  we 
can  see  that  if  also  0  and  x°(t^)<g(t^}  we  can  obtain  the 

reverse  inequality  in  the  same  manner,  thus  obtaining  W(tG)  -  W(t^). 
Taking  ^  to  be  this  common  value  we  obtain  the  conditions * 

W(t)  ^  ,1  if  x°(t)  *  g{t) 

w(t>  a  ^  if  o  <:  x°(t)  <  g<t) 

W{t)  <  /t  if  x°(t)  S  0 

These  conditions  hold  for  all  points  at  which  W,  and  g  are 
approximately  continuous  and  hence  a.e.  and  the  necessity  is  proven. 

With  this  lemma  we  are  now  ready  to  prove  our  first  theorem. 
Theorem  ¥.  Given  g  and  X  as  before  and  a  function  f  defined  on  En+i 
(or  at  least  that  portion  having  non=negative  first  coordinate)  such 
that  f  (x(t),t)  (the  first  partial  derivative  by  the  first  coordinate) 
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/■ 


fx(*  (t)st) 


is  an  integrable  function  of  t  for  all  x  £.  X.  If  x  (t)  maximizes 
fC  over  x  £  X,  then  there  is  a  number  A  such  that  for  almost 

11  t  • 

^  A  if  x°(t)  =  6(t) 

^  A  if  o  ^x°(t>  <  g(t) 

^  ^  if  x°(t)  s  0 
(The  problem  and  constraints  set  forth  in  the  above  hypothesis  shall  be 
referred  to  as  Mthe  Basic  Problem**  throughout  the  remainder  of  this  sec¬ 
tion-  } 

Proof  * 

o 

Suppose  x  (t)  maximizes  the  integral  subject  to  the  constraints  on 

1 

X*  Then  let  x  (t)  be  any  other  function  from  X* 

Define 


K 


1  O 

0X  (t)  ■+*  (1  -  9)  X  (t) 


for  0  ^  G  <  1 

Obviously  x^(t)  £  X  for  all  ££  £To ,  1^7 - 


o 

X  ,  t) 


Let  F(0)  s  J f(x®(t),t)  =  Jf(&xl+(l  ~9) 

Now  since  x°  maximizes  the  integral^ F( Q)  has  its  maximum  at  Q  t  0  and 

©  exists  for©£[p,lJ7  (we  take  the  derivative  from 


since  f  exists 


the  right  at  0  and  from  the  left  at  1).  So  d  F  I 

d  Q  \6~  0 

must  be  negative.  But; 


d  F 

d  6 

So  we  have  % 


Jf-X(  (1  “  0  )x°,  t)  £x*  -  x°] 


iLL  I  -  [f  (x°(t)  ,t)  £xl  -  x®/ ^  0 
d&  \0;  0  J  X  J 


for  all  x^  £  X 
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But  this  is  the  problem  stated  in  the  lemma  with 
W(t)  r  f  (t) 9  t)„  So  by  application  of  the  lemma  the  theorem  is  ob¬ 
tained. 

When  the  function  f(x»t)  has  convexity  or  concavity  properties  we 
can  determine  even  more  about  the  nature  of  the  maximizing  solution  as 
the  following  theorems  will  show. 

For  simplicity  we  shall  consider  two  functions  that  differ  on  a  set 
of  measure  zero  to  be  equal  in  the  following  three  theorems: 

Theorem  VI.  Given  the  basic  problem^,  if  f  (x,t)  is  strictly  decreasing 
in  x  for  all  t*  then  there  exists  a  number  X  such  that: 

x°<t»  0  if  and  only  if  fx(0,t)>A 
where  x°(t)  is  the  maximizing  solution. 

Proof v 

a.  x°(t)  >  0  fx(0,t>>^; 

o  v 

Since  f^(x,t)  is  strictly  decreasing  we  have  for  x  (t)>  0 

(1)  fx(0,t)>  fx(x°(t),t) 

From  Theorem  I  we  have 

(2)  x°(t)  >  0  =>fx(x°(t),t)a-  X 

Combining  (1)  and  (2)  we  obtain 

fx(o,t>  >  A 

b.  fx(0,t)> ^=^x°(t)>  o: 

or  equivalently  x°(t)  =  0=^  ^(Ojt)^^. 

but  this  is  the  conclusion  of  Theorem  V. 

Theorem  VII.  Given  the  basic  problem,  if  f  (x,t)  is  strictly  increasing 
in  x  for  all  t  and  x°(t)  is  a  maximizing  solution,  then 
o(£t:  0  <  x°(t)  <  g(t)J^  :  0. 
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Proof  Suppose  we  have  an  x°(t)  such  that  n($)t  m  ([t  :  0<x°(c)  <y(t)j^o. 
Let  t ^  &  t be  distinct  points  of  S  such  that  xc  and  g  are  approximately 
continuous  at  &  t2®  Recalling  the  variational  technique  employed  in 
Lemma  1  we  take  7^  -  1/4  and  £  >  0  such  that; 

3c°(t  j_)  ~h  4  B  <  gC t L> 
x°(t2)  +  4  £  <  g(t2) 
x°(t1)>  3  £ 
x°(c2)  >  3  6 


Define ; 

ElX  S  £t  :  |x°(t)  *  x°(tl}|<£'J 

E|8  x  £t  3  g(t)  >  gttp  -  6  j 

e2X  r  :  lx°(t)  ' 

E2&  £  ft  :  g(t)  >  g(t2)  *  S] 

We  then  find  ^x,  &2i»  <£28  >  0  such  that: 

for  tx  £  ILX  £  S*t  m(E1xmiX»  3/4  m(I  x) 

tL  £  &m(I18)<51y,  mCE180  l18)>3/4  ra(IL8) 

t2  £  I2X  &  tn(l2x)<  <S2X,  m(E2xni2X)>  3/4  m(I2x) 

t2  £  I28  &  ro(I28K'<528,  m(E2gni2g)>3/4  m(I28) 

Now  select  6>  0  such  that  6<  min  <£*.  &8,  6*.  &>’> 

i  i  2  2 

and  &  I ^  such  that  t^  £  X  ,  t^  6  I2  » 

Ij_  o  I2  -  0  and  ™Ci][)  r  m(l2)  :  £  . 


Let;  E  s  E  *0  E/D  Ij 

e2  =  E/n  e2s  ^  i2 
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Nows  ro(E|)  “  =*  “  Ej)  s  m(Ij)  “  ®(I^  -  (E^Ej®)) 

*  m(I  )  -m([tl  -  E1J(yfl1-Eig) 

E*)  -  Bdj  -  E18) 


>m(I1)-  1/A  mdj,)  -  1/A  m  CIX>  =  1/2  m(I  ) 


Sismilarly  we  obtain  1/2  m(l^)  a31^  as  ^e^ore  we  obtain  the 

inequality t 


1/2  < 


Now  defines 


x 


We  observes 
on  E^2 


f  o 

x  (i)  -h  t  9  on 


o 

X  (t)  ” 

IB  <{  E  ^  ^ 
m(E2) 

£ 

a  on  E, 

x°(t> 

3  on 

- 

CE^  E2) 

o ,  , 

X  (t)  - 

£  , 

on 

ei 

X°(  t)  -f 

mCE^ 

£ 

,  on  E 

ib(E2) 

X°(t) 

,  on 

-(E^Ej 

x  (t)  £  x°(t)-/-£  >  x°(t) &  0 

xl(t)  s  x°(t}y-£  <  x°(tl)+  2£  <  g(t1)  -£  <  g(t) 
x2(t)  £  x°(t)  <£  >  x°(t2>  -  2£  >  0 
x2(t)  s  x°(c)  -£  <  x°(t)  <  g(t) 
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on  E2 1  x 


X°<t) 


sai<  E2  5 


£  >  x°(t)  -  2  £>  x°(tl)  -  3£>  0 


X  (t)  5  x 


o 


mCEu)  © 

x°<t)^  g(t) 

m(E2) 


x2Ct)  *  x°(t)  + 


£  >  X°(t)  ^  0 


m 


(e2) 


£<£  x°Ct)+-2£'<x°(t1)+3f  <g(cl; 

- 1  <  g(t). 


is 

’l 

m(E, 


m(El'  '£  -  /  x" 

mCEg)  /  j? 


2  /  o  . 

x  2  I  x  + 


m 


<e2) 


f€ 

E, 


o 


1  2  _ 

Thus  x  &  x  e  X  . 


We  now  observe  that  x  <1 


x  ( t)  -f*  x  Ci 


but9  since  f  is  convex  (£  (x*t)  is  strictly  increasing  in  x)  we  have; 
f(x°(t)#t)  <  1/2  f(xl(c)„t)  +  1/2  f(x2<t),t)  for  all  t  and  thus 


JW 


/ 


t)<  1/2  f(x  +  1/2 


/ 


so  that  either  x  or  x  (or  both)  yields  an  integral  greater  than  x  . 

Thus  any  x°  such  that  m{  £x  :  0  <x°(t)<  )  >  0  can  not  be  the  maxi¬ 

mizing  solution  and  the  theorem  is  proven. 

Theorem  VTlIo  Given  the  basic  problem  with  £(xyt)  twice  continuously  dif¬ 
ferentiable  by  x.  If  x°(t)  is  the  maximizing  solution  and  we  let 
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S^(x°)  r  [t  :  fxx(x°,t)  >  o] 

s2 s  £t  s  o  <  x°ct>  <  g(t>J 

and  S(x°)  -  SjCx0)  f) S2(x°) ,  then  mCSCx0))  =  0. 

Proof  s  Suppose  we  have  an  x°(t)  such  that  m(S(x°))  s>  0. 

On  S(x°)  choose  £  (t)  ^  0  such  thats 

1 

x°(t)  -  ^(t)  >  o 

X°(t)  ■+•  £j_(t)  ^  g(t) 

and  ^  ®  such  that; 

for  xV)  *  S2(t)  ^  x(t)<  x°(f)+  ^(t),  fxx(xst)>  0. 

This  can  be  done  since  £  is  continuous, 

xx 

Let  £(t)  s  min<  £^(t) „  £2(0). 


Now  consider  the  problem; 
(1)  Maximize 


f (x, t) 

S(x°) 


subject  to; 


(2)  I  x(t) 


1 S(x°) 


o 

x  (t) 
S  (x°) 


(3)  x”(t)  -  £  (t)  ^  x(t)  x°(t; 


£  (t) 


If  x°(t)  maximizes  the  original  Integral,  then  if  we  let  x*(t)  s  x°(t) 


restricted  to  $(x°)  ,  x^(t)  must  provide  a  maximizing  solution  to  this 

new  problem. 

If  we  now  let  y(t)  *  x(t)  -  x01  (t)  •+■  £  (t)»  we  obtain; 
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(I")  Maximize 


S(x 


f(y(t 

0-4, 


+  x°(t; 


£  (t)  ,  t) 


subject  tot 


(3")  0  ^  y(t)  <  2^(t) 

We  note  that  ffy(t)  -#-x°(t)  *  £(t)  s  t)  can  be  written  h(y(t)  ,  t) 
since  x°  and  £  are  fixed  functions  of  t.  We  further  see  that 
hy(y(t),t)  =  fKCy(t)*t)  and  h  (y(t),t)  r  fxx(y(t),t)  so  we  have 

hyy(y(t),t)  >  0  on  S(x°) 

and  by  Theorem  VII  for  y°  to  be  a  maximizing  solution  we  must  have 
y°(t)  r  0  or  2  £  for  almost  all  t  in  S{x°).  But-; 
y°(t)  :  0  implies  x*(t)  s  x°(t)  +  £  (t) 
y°{t)  s  2£  implies  x*(t)  «  x°( t)  -  £  (t) 

Thus  any  x° ( t )  such  that  m(S(x°))^  0  can  not  be  the  maximizing  solution 
to  the  original  problem  and  the  proof  is  complete. 
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5. 


Examples  of  the  Continuous  Case. 

In  this  section  we  shall  illustrate  some  applications  of  the  the©* 


rems  of  the  last  section  by  means  of  examples  and  shall  cite  references 
for  further  reading  for  the  interested  reader.  We  shall  use  as  our 


primary  example  the  problem  of  search  as  formulated  by  B.  0.  Koopman  [ll] . 


A  study  of  Koopman's  article  and  his  indicated  generalizations  will  make 
readily  apparent  how  much  less  restrictive  the  theorems  of  Section  4  are 
than  similar  theorems  from  the  calculus  of  variations.  We  shall  also 
show  the  Neyman-Pearson  lemma  of  statistics  to  be  a  special  case  of 
Lemma  I  when  the  selection  of  a  most  powerful  test  of  a  hypothesis  is 
looked  upon  as  an  allocation  problem. 

Example  1.  The  Koopman  Search  Problem. 

Suppose  we  are  searching  for  an  object  which  may  be  represented  as 
a  point  on  the  real  line.  We  desire  to  apply  a  fixed  amount  of  search 
effort  along  the  line  in  such  a  manner  as  to  maximize  the  probability  of 
detecting  the  object.  Detection  can  be  represented  as  a  Bernoulli  trial 
with  a  parameter  dependent  on  location,  X,  and  effort  ^  .  More  speeifi* 
cally  the  conditional  probability  of  detection  with  effort  (f)  (x)  given 


the  location  of  the  object  is  in  fact  x  is  assumed  to  be 
(This  assumes  that  all  portions  of  the  line  are  equally  susceptible  to 
search,  which  assumption  could  be  deleted.)  Assuming  X  has  the  marginal 
density  function  p(x),  we  have  the  unconditional  probability  of  detec* 


tion  given  by: 


So  our  problem  is  to  find 


that  will  maximize  subject 


to : 
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(2) 


We  now  observe  that  in  the  terminology  of  Section  4  we  have* 

(3)  f(0,  x)  :  p(x)(l  -e-0<x>) 

(4)  x)  r  p(x)e'^(x) 

(5)  =  -P(x)e‘^x)  ^0  for  1/ x 

From  (5)  we  see  that  Theorem  VI  applies  wherever  p(x}>0  and  where 
p(x)  r  0j(^(x)  obviously  will  be  zero,  so  we  can  assume  Theorem  VI  to 
hold  throughout.  So  we  know  that  there  is  a  number  a  such  that: 

(6)  0°(x)  >0  iff  p(x)>A 

Since  we  have  no  upper  bound  on  J^(x),,(g(x)rr  oc)  we  also  have  from 
Theorem  V  and  (6 ) : 


(?) 


(p(x)  e  ^  .  A  for  p(x)>  A 


^°(x)  =  0  for  P(x)^:  A 

Taking  logarithms  of  both  sides  of  the  upper  equation  in 


we  ob¬ 


tain  ; 


<t>°w 


In  for  p(x)>A 


0  for  p(x)<:A 

from  (2): 

(£)  z  f (f>° (x)  dx 

;x  9  p(x)>A 

Thus  we  can  use  the  following  graphical  method  to  find  the  solution 
0°(x). 


In  ^  dx 


'In  p(x) -  In  A )  dx 

)%  9  p(x)>^ 
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Seep  (1).  Graph  in(p(x))  far  all  %  at  which  p(x)>Q  this  graph 


look  like  Figo  1. 

Ir i(euj) 


Step  (2)o  Draw  a  horizontal  line  i?  parallel  to  the  x  axis  and  move 
it  up  and  down  until  the  area  (shaded  in  Fig.  1)  above  the  line  and  under 
the  curve  1e(p(x})  is  equal  to  $  •  Mark  off  A  *  (A^s^*..*)  the  projec¬ 
tions  on  the  x  axis  of  the  segments  cut  off  from  by  the  graph  of 


Step  (3).  0(x)  r  0  outside  of  ApA2»*««  Inside  these  intervals 

$(x)=ln  p(x)  “  ln(^)  is  equal  to  the  length  of  the  vertical  segment 
from  H  to  ln(p(x})  for  the  %  in  question 

This  completes  the  solution  to  the  problem.  However „  we  can  obtain 
further  information  which  might  prove  useful • 

Step  (4).  Graph  on  the  same  graph  p(x)  and  the  line  y  *  A  (Fig.  2) 

ft*-) 
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p' (x)  r 


Then  the  area  (shaded  in  Fig.  2)  above  /K  and  below  p(x)  is  the 
probability  of  successful  search,  P.  The  a-postiori  probability  density 
of  the  location  of  the  object  p' (x)  is; 

p<x)4.P  f°r  x  a 

for  x  £  A 

So,  if  after  an  unsuccessful  expenditure  of  effort  £  a  new  quantity 
^  of  effort  becomes  available,  its  optimum  distribution  can  be  computed 
using  p'{x)  instead  of  p(x).  In  this  case  (exponential)  it  turns  out  that 
our  optimum  probability  of  detection  for  allocation  of  i+r  units  of 
effort  is  the  same  whether  we  apply  it  in  successive  stages  or  all  in  one 
stage. 

Example  2.  The  Neyraan- Pearson  Lemma. 

We  shall  now  show  that  the  Neyman-Pearson  Lemma  of  Statistics  is  an 
application  of  Lemma  I  under  suitable  identification. 

Suppose  we  have  observations  taken  on  n  random  variables  (or  as  Is 
usually  the  case  n  observations  of  the  same  process).  We  desire  to 
test  the  hypothesis  that  the  joint  density  function  f  .  o  oX^)  is  a 

given  function  fQ  against  the  alternative  that  f (x^ aXjs . . .x^)  is  another 
function  f^  at  significance  level  . 

By  significance  level  0(  we  mean  we  want  the  probability  of  reject¬ 
ing  the  hypothesis  when  it  is  true  to  be  less  than  or  equal  to  0(.  If 
we  define  the  power  of  the  test  to  be  the  probability  of  rejecting  the 
hypothesis  when  the  alternative  is  true  we  might  then  desire  to  find  a 
criterion  based  upon  the  observations  that  will  maximize  the  power  for 
the  given  0( .  If  such  a  test  exists*  it  is  called  the  most  powerful 
level  <X  test. 
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If  we  let  t  s  Cxii9x2s>  •  *  we  ^]ave  probability  of  rejecting 


the  hypothesis  when  it  is  true  is 


where  A  is  the  set  of  points 


t  whose  observation  would  cause  us  to  reject  the  hypothesis «  Thus  a 
test  (or  procedure)  is  a  selection  of  a  set  A  (or  a  partition  of  En)  such 
that  we  reject  the  hypothesis  if  the  observation  x  lies  in  the  set  A. 

The  set  A»  so  determined 9  is  called  the  critical  region.  Similarly  the 
power  of  the  test  may  be  written? 


0 

Our  problem  then  is  to  find  the  set  A  that  yields  the  maximum 
power  for  our  level  test.  Letting  be  the  characteristic  function 
of  the  set  A  our  problem  is  to? 

maximize  /  fj(t)  CA(t)  The  power  ©f  the  test  using  critical 
J  region  A 


subject  to? 


~  c*  - 

A 


/ 


f0CO  cACt)^o( 


test  must  be  of  level  o(  . 


We  now  let? 

x(t)  *  f0(0  CA  (t) 

W(t)  s  —  ^  If  were  zero  we  would  obviously 

reject  the  hypothesis  upon  observation. of 
t  so  we  can  restrict  our  problem  to  the 
region  wherein  f®(t)>0„  Thus  we  shall 
assume  f0(t)  0  throughout  the  problem. 


Our  problem  now  becomes; 

(3)  maximize  Jw(  t)x(t) 

subject  to;  (4)  0  x(t)  ^  f  (t) 

o 

x{.t)  — 

Since  W(t)  is  nom-negative  we  can  without  loss  of  generality  write 


/’ 


(5)  as; 
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(6)  Jx(t)  =  ot 


Application  of  Lemma  I  to  the  problem  of  (3),  (4)  and  (6)  tells  us 
that  for  x°(t)  to  be  a  maximizing  solution  there  must  be  a  number  A 
such  that  if 

✓ 

<A’  x°(t)  -  0 


(7) 


W(t) 


x  (t)  r  f  (t) 
o 


=  A>  x°(t)  is  undetermined. 


Mt) 

(8)  if  fjt) 


Substituting  for  x  (t)  and  W(t)  in  (7)  we  obtain; 

>  cAo<t>  fo(t>  ,  f0(t) 

<  A  »  CA°(t)  fQ(t)  r  0 

=  A  >  undetermined 
o 

Recalling  the  meaning  of  A  (t)  we  have  the  conclusion  that  the  most 
powerful  test  of  hypothesis  at  level  C<  consists  of  determining  a  number 
A  (depending  on  fj_,  f  and  Ci)  and  to; 

f 1 < t)  _  Q 

reject  the  hypothesis  if 

r  o  ( *- .) 

MO  ^ 

accept  the  hypothesis  if 

C  ^  ^ 


we  have  no  test  if 


fi<fc>  s  A  . 


where  t  is  the  observed  vector* 

These  two  examples,  while  more  meaningful  than  those  of  Section  3s; 
certainly  fall  short  of  illustrating  the  full  power  of  the  theorems  of 
Section  4.  The  interested  reader  can  find  much  more  sophisticated  and 
meaningful  examples  in  the  papers  by  Danskin  and  Gi liman  [3]  and 
Danskin  .  A  particularly  interesting  problem  is  investigated  by 
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Karlin,,  MadoWjj  amid  Pruitt  [lOj  who  attack  the  problem  of  determining 
optimum  firing  rates  as  a  function  of  range  for  a  weapon  of  given  charac¬ 
teristics  against  a  particular  type  of  target  and  then  proceed  using 
these  maximum  payoff  functions  to  consider  optimum  mixes  of  several 
types  of  weapons  against  supposed  mixes  of  targets  subject  to  an  overall 
cost  or  weight  restriction  on  the  weapons,,  A  recently  published  attack 
on  this  same  class  of  problems  but  more  restricted  than  the  one  of  this 
paper  can  be  found  in  the  article  by  Zahl  Qa] . 

For  the  reader  who  is  interested  In  a  particularly  thorough  discus¬ 
sion  of  the  approach  to  problems  of  this  type  the  two-volume  set  of 
books  by  Karlin  K)  is  recommended,  especially  Chapter  8  of  Volume  II. 
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